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Abstract 

When a set of permutations comprising a pattern class C is submitted 
as input to a priority queue the resulting output is again a pattern class C'. 
The basis of C' is determined for pattern classes C whose basis elements 
have length 3, and is finite in these cases. An example is given of a class 
C with basis {2431} for which C' is not finitely based. 
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1 Introduction 

The theory of permutation patterns can trace its origin back to the abstract 
datatype Stack. The earliest non trivial example of a pattern class is the set of 
permutations that can be sorted by a stack, which is the same as the set of 231- 
avoiding permutations. This class was first studied and enumerated by Knuth 
in Volume 1 of [5] where he also showed how to characterize and enumerate the 
pattern class associated with the more complex datatype Restricted input 
deque. Over a period of more than 40 years generalizations of Stack have 
appeared several times in the pattern class literature (see [8] for a survey). 

Stacks are characterized by their removal rule: when an item is removed from a 
stack it is always the most recently inserted item that is removed. By contrast 
the datatype Priority queue is characterized by a different removal rule: the 
removed item is always the entry of smallest value. The associated sorting 
problem is trivial: a priority queue can sort every permutation. Despite this, 
as we shall see below, there are pattern class aspects of priority queues that are 
very challenging. 

The study of pattern classes is also the study of the pattern containment order. 
For our purposes it will be helpful to give a somewhat abstract description of 
this order. Let a and /3 be two sequences of distinct values from some linearly 
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ordered set. We say that a and ft have the same pattern or are isomorphic, 
and write a ~ ft, if they have the same length n and, for all 1 < i,j < n, 
on < ctj if and only if fti < ftj. It is not even essential for this definition that 
a and ft be sequences from the same set, and allowing this ambiguity it is clear 
that every finite sequence a of distinct values from some linearly ordered set 
is isomorphic to a unique permutation of [n] = {1,2, ... ,n} (with its usual 
ordering 1 < 2 < • • • < n) where n is the length of a. 

Slightly more generally we say that a is contained as a pattern in ft if a is 
isomorphic to some subsequence of ft. In this case we write a ^ ft. It is clear 
that ^ is a partial order when restricted to permutations. If a is not contained 
as a pattern in ft then we say that ft avoids a. 

Pattern classes are, by definition, sets of permutations that are closed down- 
wards in the pattern containment order on permutations. It follows that every 
pattern class X can be defined in terms of a set B of permutations that it avoids 
as 

X = Av(B) = {a | a does not contain ft for all ft G B} 

The unique minimal set of avoided permutations is called the basis of the pattern 
class. Much of the study of pattern classes is concerned with investigating the 
structure of a pattern class given its basis. 

To study priority queues however we need a partial order defined on pairs of 
permutations. Let (a, r) be any pair of permutations of length n and let S be 
any subset of [n]. Let a\s, t\s be the subsequences of a, r whose entries are the 
members of S and let a, ft be the permutations isomorphic to (j\s,t\s- Then 
we write (a, ft) ^ (a, r) and the binary relation so defined is easily seen to be 
a partial order. In a sense made precise in [3] this order is the 3-dimensional 
analogue of the 2-dimensional pattern containment order. The two orders are 
connected via the following result which follows directly from the definitions. 

Proposition 1.1. Let B be any set of pairs of permutations that is closed down- 
wards in the order on pairs and let C be any pattern class. Then both 

CB = {t I (a, t) 6 B for some a 6 C} 

and 

BC = {a | (ct, r)eB for some r 6 C} 

are pattern classes. 

Following [7] we define an allowable pair (a, r) of permutations to be a pair such 
that a priority queue can generate t as an output sequence if presented with a 
as an input sequence. The set A of allowable pairs is easily seen to be closed 
downwards in the pair order. Indeed, it is the set of pairs that do not contain 
either of the pairs (12, 21) and (321, 132) [5]; thus Proposition 11.11 applies to A. 

This paper studies the relationship between the pattern classes C and CA for 
various pattern classes C. In other words we study the pattern class generated 
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as a set of outputs if a priority queue is presented with permutations from a 
pattern class C as its set of inputs. Usually C will be defined in terms of its basis 
and we shall want to find the basis of CA. 

As we shall sec CA is usually much larger than C. In the next result we give 
the precise condition that determines whether C — CA. To state it we recall the 
weak order on permutations of length n as the transitive closure of permutation 
pairs (a, 0) where j3 is obtained from a by interchanging two consecutive values 
of a in such a way that a new inversion is created. 

Theorem 1. Let C = Av(B). Then C = CA precisely when every permutation 
in the upward weak closure of B contains a permutation of B as a pattern. 

Proof. In the notation of relational composition C — CA if and only if C — CA* 
where A* denotes the transitive closure of the relation A. However, by a result 
of [5] , A* is the weak order and so C = CA if and only if C is closed downwards 
in the weak order. But, as shown in [TJ, this is equivalent to the condition in 
the statement of the proposition. □ 

Put another way, C — CA precisely when A — Av(X) for some set X which is 
upward closed in the weak order. 

Corollary 1.1. If C = Av(t t-1 ■■■ 1) then CA = C. 

Sadly, this result is the only case in which we have managed to determine 
Av(a)A with \a\ > 3 (though we have conjectural descriptions of the bases of 
these classes for all permutations a of length four) . For a of length 2 we already 
know from the Corollary that Av(21).A = Av(21) while the other length 2 case 
is useful enough to be recorded explicitly. 

Proposition 1.2. Av(12).4 = Av(132). 

Proof. When a decreasing sequence is processed by a priority queue the "remove 
smallest" operation becomes "remove most recently inserted" so the behavior 
is just like being processed by a stack. The result now follows from the theory 
of stack permutations. □ 

In Section [2] we consider the pattern classes Av(a)A for each of the 6 permuta- 
tions of length 3, show that all of them are finitely based and find their bases. In 
Section[3J we give similar results for Av(a, (3)A, where \a\ = \f3\ = 3 and briefly 
comment on some related results. Section [4] contains an example to show that, 
in general, Av(a)A is not necessarily finitely based. The final section considers 
briefly the case AC and discusses a number of open problems. 

Our principal tool is a result from [7]: Proposition 11.31 below. Before stating 
this result we need to define, for every sequence of distinct integers r, a poset 
P(t). The elements of P(t) are precisely the elements of the sequence r and 
the order relation -< is defined by x -< y if x precedes y in r and either 
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• xy ~ 21, or 

• X2y ~ 132 for some element z lying between x and y in t. 

Another way to think of P(t) is to write r = an/3, where n is the largest element 
of r, and then the constraints of P(r) are 

• n -< b for all b € f3, 

• a -< 6 for all a £ a, & £ /?, and 

• constraints of P(a) and constraints of P((3). 

Example If r = 31524 then P(r) has constraints 5 -<! 2, 5 -< 4, {3, 1} -< {2,4}, 
and 3 -< 1. 

If t is a permutation then a linear extension of P(t) can be considered as a 
sequence in its own right simply by listing its elements from least to greatest 
with respect to the linear order extending -<. This turns out to be intimately 
connected with the concept of allowable pair as shown by the following propo- 
sition. 

Proposition 1.3. (cr, r) is an allowable pair if and only if a is a linear extension 
ofP(r). 

We briefly discuss this result in the context of pattern classes C = Av(a). 
Suppose r is a permutation and that P(t) has a chain of the form a\ -< a 2 -< 
• • • -< a r where a^a-i . . .a r is isomorphic to a; for brevity we call this an a- 
chain. In such a case every linear extension of P(t) contains the subsequence 
aia 2 ■ ■ ■ a r and so none of them are in C. Therefore r g" CA. So, a necessary 
condition for t € CA is that P(r) should contain no a-chains. As we shall see 
in Section [4] the optimistic hope that this condition is also sufficient often fails. 
Nevertheless it does hold (see Section [2]) when \a\ —3: in other words we shall 
prove 

Theorem 2. For any permutation a of length 3, r <E Av(a)^4 if and only if 
P(r) contains no a-chain. 

The proof of this theorem is contained in Section [5] and consists basically of a 
case by case analysis of the classes Av(a)^4. 

Note that the condition that P(r) contains no a-chain can be captured by a 
finite set of avoidance conditions: 

Lemma 1.1. P(r) has a chain a\ -< <Z2 ~< • • • Ofe if and only if t has a subse- 
quence 01610262 • • • afc_i&fc_iafc smc/i that 

• if a.i > aj+i i/ien 6^ is t/ie empty term, 

• if at < aj + i f/ien &j > aj+i 
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Proof. Suppose first that the two conditions hold. The conditions are precisely 
those that ensure a\ -< 02 • • • -< are constraints of P(t). 

Conversely suppose that P(t) has a chain ai -< 02 -< • • • afe- By definition 
Oi, 02, . . . , ak appear in this order within r. A constraint of the form a, -< aj+i 
with ai < Oi+i can arise only because of some term 6j > Of+i appearing between 
ai and a^+i. □ 

In particular it follows that P(t) has no a-chain if and only if r contains no 
permutation with the two properties specified in this lemma. The set of such 
permutations is easy to compute once a is known. For example, if a = 123, we 
seek permutations axbyc with a < b < c, x > b and y > c; these are 13254, 
14253, 15243. 



2 Av (a) A when \a\ = 3 

In this section we verify Theorem [2] by a case analysis. As a consequence of 
Lemma ITTTI and the remarks that followed it we obtain the basis of Av(a).A for 
each of the 6 permutations a of length 3. The case a = 321 is already covered by 
Corollarv ll.il In each remaining case we obtain the basis of the class Av(a)A as 
a corollary to the main result, using the observation at the end of the preceding 
section. 

Note that the symmetries of the pattern containment order cannot be exploited 
here since they are not symmetries of the relation A. Essentially this is because 
the operation of a priority queue depends on both the order in which it receives 
(and outputs) elements and their relative sizes. No non-trivial symmetry of the 
pattern containment order respects both these relationships. 

Proposition 2.1. If P(t) has no 312-chain then it has a 312-avoiding linear 
extension. 



Proof. Put t — m,\T\m,i . . . mkTk where mi, . . . , m^ are the left-to-right maxima 
of t. Let Aj be the sequence of values in tj but written in decreasing order 
and put A = miAim,2A2 • ■ .m^Afe. Then A is the required 312-avoiding linear 
extension. To verify that A is a linear extension note that all the constraints of 
P(r) are respected because the only doubt would be over two elements x,y G tj 
with x < y and x -< y. But then mi -< x -< y would be a 312-chain in P(t). 
Finally A avoids 312 for, if there were a sequence zxy ~ 312 in A, then x and y 
would necessarily lie in distinct Tj and Tj. Then, because of the sequence xmjy 
in r we would have x ~< y and hence m, -< x -< y would be a 312-chain in 
P(r). □ 

Corollary 2.1. Av(312)^ = Av(3142, 4132). 

Proposition 2.2. If P(r) has no 132-chain then it has a 132-avoiding linear 
extension. 
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Proof. Suppose that r = an/3 where n is the maximum value occurring in r. 
We suppose inductively that the result is true for all permutations of length less 
than n (observing that the base case of n = 1 is trivial). 

If a is empty, then we can simply (by induction) take n followed by a 132- 
avoiding linear extension of P(/3) to obtain a 132-avoiding linear extension of 
t. So, henceforth assume that a is non-empty. Partition the values occurring 
in a into an increasing sequence of non-empty intervals X\, X 2 , ■ . . , Xk, such 
that if Xi G Xi and Xj+i G -Xj+i, then some element of j3 lies between them in 
value. Similarly partition the elements of /3 into intervals Yi for < i < k + 1 
such that the elements of Yi lie above X t and below X i+1 (with the obvious 
modifications for Y and Yfe+i). Note that all the Yi except possibly Y and 
Yfc+i are non-empty. 

Consider the constraints of P(r) between elements of a. Such constraints arise 
precisely from the constraints of P(a). By induction we may find a 132-avoiding 
linear extension of P(a) and it will not violate any constraints within the super- 
poset P(t). In this linear extension let Xi be the subsequence whose values come 
from Xi. 

There are no poset constraints of the form £j -< £j with i < j, £i G Aj, £j G Xj 
because, with y G Yi, £\ < l 2 < y would be a 132-chain of P(t). So, in fact, 
we may take the linear extension of P(a) to have the form A = • • • A3A2A1 (in 
rearranging the A, in this way we cannot introduce a 132-subsequence since they 
now form a descending sequence of intervals of values, so the only possible 132 
occurrences would be within a single Aj and we know already that this does not 
take place). 

The values of Y\ U Yi U . . . occur in increasing order in /3 (because if two of them 
z, y say occur in decreasing order then, with x G X\, we would have a 132-chain 
x -< z -< y). Hence these values also form an antichain of values in P(r) because 
there are no intervening larger values. 

Furthermore there is no constraint yo -< y in P( T ) with y^ G Yq and y G 
Yi, i > as such a constraint could arise only from some intervening term 
of Yi U Yi U . . . larger than y contradicting the previous observation that the 
elements of Y\ U Yi U . . . occur in increasing order. Hence, (using induction 
again) taking ^ to be a 132-avoiding linear extension of P(Y ), and // to be 
the terms of Yi U Yi U . . . in increasing order, \x — fi'fio is a linear extension of 
P(/3) that obviously avoids 132. 

Now it follows that nA/z is a 132-avoiding linear extension of P(r). The check is 
routine. Clearly any 132-patterns must lie across A and /1. But one element in 
A and two elements in fi is impossible because the elements on [i would have to 
occur in p! (being larger than some element of a) and /i' is increasing. Likewise, 
two elements in A and one in fj, is impossible because the first two elements 
would have to lie in some common Aj and the third could not separate them by 
value. □ 
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Corollary 2.2. Av(132)„4 = Av(1432). 

Proposition 2.3. If P(t) has no 231-chain then it has a 231-avoiding linear 
extension. 

Proof. Again we will proceed inductively. Let r avoid 2431 (the condition that 
its poset has no 231-chain) and consider its left-to-right maxima. If r has 
only one left-to-right maximum, i.e. r = nr' then with A' a 231-avoiding linear 
extension of P(t'), we have nX' as a 231-avoiding linear extension of P(t). So, 
assume henceforth that r has at least two left-to-right maxima, and let the 
values of the left-to- right maxima be denoted m\, m,2, • ■ • , rnk- 

The non-left-to-right maxima fall into layers of values between successive max- 
ima and these sets of values occur left to right in r (from the 2431 condition). 
The situation is illustrated in Figure [1] where the grey boxes represent sub- 
sequences 61,82, ■■ - Ok of r. While the values in each 8i are, by definition, 
contiguous they are not necessarily contiguous by position since they may be 
punctuated by left-to-right maxima lying above them. 




Figure 1: The generic structure of a 2431-avoiding permutation 

Put r = t\T2 ■ ■ ■ Tfc where each n consists of 9i together with its punctuating left- 
to-right maxima (if any) ; include in Tj any left-to- right maxima that immediately 
precede 6^. The constraints of P{t) have two possible forms: they are constraints 
of P(Ti) or of the type t{ -< tj with ti £ Tj, tj s Tj and i < j. Notice that none 
of these constraints have the form t -< rnt. 

By induction we may find a 231-avoiding linear extension of each P{ri) (unless 
Ti = t\- in this case take a 231-avoiding linear extension of t with m\ deleted). 
In each such linear extension let \ denote the sequence of values belonging to 
Qi] this too avoids 231. 

Consider mkmk-i ■ ■ ■ miAiA2 • ■ • ■ This is a linear extension of P(r) that also 
avoids 231. □ 

Corollary 2.3. Av(231)^ = Av(2431). 

Proposition 2.4. If P(t) has no 213-chain then it has a 213-avoiding linear 
extension. 
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Proof. Put r = an(3 where n is the maximum value that occurs in r. As always 
we proceed by induction, and as always, the case where a is empty is trivial. 

Similarly to the notation of Proposition 12.21 we partition the set of values oc- 
curring in a and f3 into intervals Xq, Yu X\, Y\, . . . , Xk, Yk, Xk+i where each 
member of this list is a set of values smaller than its successor in the list and 
where the elements of Xi are terms of a and the elements of Yj are terms of f3. 
These sets are non-empty with the possible exception of Xq and Xk+i- 

The set of values from Xq U Xi U • • • U Xk occur in increasing order in r because 
if there were a decreasing pair vu then, with w£Yk,v<u~<w would be a 213- 
chain in P(r). We write a — <^o^i<^i^2 • ■ • r (j> r where 6^62 ■ ■ ■ r is the increasing 
set of values from XqU- ■ -UXk and 4>o<pi • ■ ■ <f> r are separating sequences of values 
comprising the set Xk+i (all non-empty except possibly for (f>o and <j> r ). The 
constraints of P(t) between the elements of Xq U Xi U • • • U Xk are easily seen 
to be only of the form a -< b where a £ 6i, b £ 9j and i < j. There are no 
constraints between elements of any 0j. Moreover, the set Tj of elements of di 
forms a poset interval in P{a). 

Now, by induction, we can find some 213-avoiding linear extension of P{a). 
Then we can arrange the values of each poset interval Tj in increasing order 
without introducing a 213-subsequence obtaining another linear extension A. 
Note that, in A, all elements of Xq U Xi U • • • U Xk occur in increasing order. 

Next observe that there is no constraint of P(r) of the form u -< w with u £ Yj, 
w <E Yj and i < j; for then, with v G Xi, v -< u -< w would be a 213-chain of 
P(t). Let fa be the sequence of values of Yj as they occur in /3. By induction 
we can find 213-avoiding linear extensions fa of each P(j3i) and then jj,k ■ ■ ■ 
will be a 213-avoiding linear extension of P((3)- 

Finally, consider the permutation nXfi. This is certainly a linear extension of 
P(t). Furthermore it has no 213-subsequence. Clearly there can be no 213- 
subsequence containing n, nor contained entirely within A or within [i. There 
cannot be a 213-subsequence bac with both 6, a £ A because X n U X\ U • • • U Xk 
occur in increasing order and so one of b, a would have to lie in Xk+i (and then 
there is no larger element in j3). Nor could we have b £ A and a,c £ jj, because 
then a, c would need to lie in some common Y, and b could not separate them 
by value. □ 

Corollary 2.4. Av(213)^ = Av(2143). 

Proposition 2.5. If P(t) has no 123-chain then it has a 123-avoiding linear 
extension. 

Proof. Again we let r = an/3 where n is the maximum element occuring in r, 
and again we may as well assume that a is non-empty. By induction we can 
find 123-avoiding linear extensions of P(a) and P(/3) and so we can find linear 
extensions of P(r) which consist of n followed by 123-avoiding linear extensions 
of the entries of a and the entries of /3. We will argue that for any linear 
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extension, e = nA/i, of this type containing a 123-subsequence there is another 
linear extension of the same type that has more inversions than e docs. 

Suppose that v has a 123 pattern xyz. Either x, y G A and z S fx or x € A and 
y, z £ /i. Suppose that the former occurs and, for the given z, take x, y as close 
in position as possible. 

We know that x -ft y (for certainly y < z and there is no 123-chain in P(r)). If 
x and y are adjacent in A then because x -fi y we can exchange x and y and get 
a new linear extension of the same type with one more inversion. 

So suppose that there is some intervening element w occurring immediately 
after x in A where, by choice of x, y, we shall have w > y. If x -fi w we may 
exchange x and w and get a new linear extension of the same type with one 
more inversion. 

On the other hand, it is not possible that x -< w. If it were then we would have, 
in a, a subsequence xtw for some t > w. Now, certainly y succeeds i in q (or 
we would have y -< x and y, x would occur in this order in A) but y cannot occur 
after t in a (that would mean, because of the sequence xty, that x -< y) and it 
cannot occur between x and t in a for then the sequence ytw in a would mean 
that y -< w contradicting that w precedes y in A. 

Exactly the same argument applies to xyz sequences with x £ A and y, z <E fi. 
So, if we take e = nA/i to be that linear extension of P(r) having the maximum 
possible number of inversions, it must avoid 123. 

□ 

Corollary 2.5. Av(123)„4 = Av(13254, 14253, 15243). 

3 Av(a,/3)A when \a\ = \fi\ = 3 

There are 15 pairs (a,j3) of permutations of length 3. The structure of each 
of the pattern classes they define is well-known but we do not know of any 
convenient reference to that structure. So, for completeness, we list in Table [1] 
descriptions of these 15 pattern classes C leaving the elementary justifications to 
the reader. The ordering of the rows in that table groups similarly structured 
classes together. The notation used is fairly standard. I and V denote the 
classes of increasing and decreasing permutations respectively. The sum of two 
permutations a © t is that permutation s\ . . . s p t\ . . . t q where s\ . . . s p ~ a, 
t\...t q ~ t and Si < tj for all Skew sums, a r, are defined similarly 
except the final property is Si > tj for all i,j. Notation such as 213[X, 1, X] 
denotes the class of all inflations of 213 in which each term is replaced by an 
increasing sequence of consecutive values. 

We now justify the final column of Table [T] treating each case in turn. In all cases 
it is routine to verify that none of the claimed basis permutations j3 lie in CA. 
We simply have to verify that, if f3 is a proposed basis element, then all linear 



9 



Index Basis of C Structure of C 



Basis of CA 



1 


132, 


321 


213(1, 1, 1] 


321, 2143, 2413 


2 


213, 


321 


132 [1,1,2:] 


321, 2143, 2413 


3 


231, 


312 


Sums of decreasing 
permutations 


2413, 2431, 3142, 4132 


4 


231, 


321 


Sums of t 1 2 • • • t - 1 


231,321 


5 


312, 


321 


Sums of 2 3 • • • t 1 


312, 321 


6 


123, 


231 


312[V,V,V] 


2431, 13254, 13524, 
14253, 15243, 31524, 
461325 


7 


123, 


312 


231[V,V,V] 


3142, 4132, 
13254,13524,13542 


8 


132, 


213 


Skew sums of increasing 
permutations 


1432, 2143,13524 


9 


123, 


132 


Skew sums of 
t-lt-2 ■■■It 


1423, 1432, 13254 


10 


123, 


213 


Skew sums of 
ltt-1 ---2 


1243, 2143 


11 


132, 


231 


Permutations whose 
diagram is shaped like V 


1432, 2431 


12 


132, 


312 


Permutations whose 
diagram is shaped like < 


132 


13 


213, 


231 


Permutations whose 
diagram is shaped like > 


2143, 2413, 2431 


14 


213, 


312 


Permutations whose 
diagram is shaped like A 


2143, 3142, 4132 


15 


123, 


321 


Finite 


321,1423, 2314, 2341, 



4123, 12345, 12354, 
12435, 12453,13245, 
13254, 21345, 21354, 
21435, 21453, 31245, 3125 



Table 1: The structure of classes C having two basis elements of length 3, and 
the corresponding bases of the classes CA. 
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extensions of P{0) involve one of the basis permutations of C. The proposed 
bases were in fact produced by computer search precisely with respect to that 
property. Thus we shall only be concerned with proving that a permutation r 
that avoids these basis permutations is an image of some permutation in C. 

Case 1: The basis of Av(132, 321)^4 

Permutations r G Av(321, 2143, 2413) are merges of two increasing sequences L 
and U (with L < U) (this is a symmetry of a result in [3]). It is readily checked 
that P(t) has only constraints u -< I with u G U, £ G L and constraints £\ < £2 
with £±,£2 Si and £\ < £2- Therefore P(t) has a linear extension in which the 
terms of L and the terms of U occur in the same order as they do in r, and all 
the terms of L precede all the terms of U ; such permutations lie in Av(132, 321) 
(indeed they lie in Av(132, 213, 321)). 

Case 2: The basis of Av(213, 321)^4 

The proof is exactly like the previous one. 

Case 3: The basis of Av(231, 312)^4 

When a permutation that is a sum of decreasing permutations is processed 
by a priority queue the possible outputs are precisely sums of permutations in 
Av(132) (see Proposition II .2[) . But, from a (symmetry of a) result of [5], the 
class of all such permutations is Av(2413, 2431, 3142, 4132). 

Case 4 and case 5: The basis of Av(231, 321)^4 and Av(312, 321).4 

These follow from Theorem [T] 

Case 6: The basis of Av(123, 231)^4 

Let t G Av(2431, 13254, 13524, 14253, 15243,31524,461325). We divide the ele- 
ments of t into three sets: 

• A is the set of elements that play the role of '1' in a 132-subsequence of r 
together with all elements less than any of these, 

• B is the set of elements that play the role of '2' in a 132-subsequence of 
r, 

• C is the set of any remaining elements. 

The goal is to show that 7a/? is a linear extension of P(r) where a, /?, and 7 
are decreasing permutations whose elements are equal to the elements in A, B 
and C respectively, and that ^a(3 G 312[X>, V, T>\. 

First we will verify that A U B U C is a partition of the terms of r. It suffices to 
prove that A n B is empty. It is easy to check that no element can both be a 
'1' in a 132 and a '2' in a 132 (take the copy in which it is a '2', append the 32 
of the copy in which it is a '1', and one of the basis elements 13254, 14253, or 
15243 results). The remaining case is that of an element a, which is a '2' in a 
132 that lies below some T' of a 132. Call that 132 bdc. Then, since a is not a 
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'1', and 2431 is a basis element, we must have b,d,a,c occurring in this order. 
Now let xya be a 132. In all cases the set of elements {b, d, c, x, y, a} contains a 
subsequence matching one of the basis elements. 

Next we prove that, for all a E A, b E B, c E C, we have a < b < c. To do 
this we merely have to prove that if b E B, b' < b, b' A, then b' E B. So let 
xyb ~ 132. Since b' £ A, b' > x and b' follows y in r (else b'yb ~ 132). But then 
xyb' ~ 132, so b' E B. 

Now define A = 70;/? where a,/3,7 are the terms of A,B,C respectively each 
written in decreasing order. So A E Av(123, 231). We shall verify that A is a 
linear extension of -P(r). 

To begin with notice that, in r, all elements of A precede all elements of B. 
For suppose b E B because of some subsequence xyb ~ 132 of r. A following 
element of A could not be smaller than x (else we obtain a subsequence 2431) 
nor larger than b (else b E A (1 B), nor between x and b (else it belongs to B). 
So, no such element can exist. In particular there are no constraints a -< b with 
a E A, b E B and so having (3 following a violates no constraints. 

Rather more easily there are no constraints a ~< c or b -< c for any a E A, b E 
B,c E C for in both cases this could only happen if c was a '2' in a 132- 
subsequence. 

Finally no constraints between elements of A, or between elements of B, or 
between elements of C are violated. Again for A and C this is clear: if a\ ~< a 2 
with ax < a 2 then a 2 would be a '2' in some 132-subsequence a\xa 2 . But also 
B has no b\ -< b 2 constraint with b\ < b 2 . For if there was a subsequence 
b±xb 2 ~ 132 then b\ E A which is a contradiction. 

Case 7: The basis of Av(123, 312)^ 

Let r E Av(3142,4132, 13254, 13524, 13542) be given. Let T be the set of ele- 
ments that play the role of a '1' in a 132-subsequence of r and let S be the set 
of remaining elements of r. Clearly t\s has no 132-subscqucncc. But t\t has 
no 132-subsequence either for if ^^3^2 was such a sequence we can find v, u with 
t?,vu ~ 132. Then we have one of tit3vut 2 , tit 3 vt 2 u, titst 2 vu which have the 
patterns 13542, 13542, 13254 all of which are forbidden. 

Furthermore the set of values of T is a consecutive set. To see this let t,t' € T 
with t < t'. Consider some x with t < x < t' . Suppose first that t precedes 
t' in t and let t'vu ~ 132. If x precedes v then xvu ~ 132 and so x E T. 
Otherwise r has a subsequence tt'vxu ~ 13524 or tt'vux ~ 13542 both of which 
are forbidden. Now suppose t' precedes t in r. There is some v, u with tvu ~ 132. 
Then t' > u (else tt'vu ~ 3142 or tt'wu ~ 4132). If x precedes v then, because 
of xvu, x E T. But otherwise the sequence t'tvx ~ 3142 which is forbidden. 

The poset P(t) has no constraints s ~< t with s E S and t ET. Such constraints 
could only arise if either 

• s > t and s precedes t in r. But then there is some tvu ~ 132 and then 
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cither stvu ~ 4132 or stvu ~ 3142 or s is smaller than both v, u and hence 
s S. 



• s < t and there is some swt with w > t. But then, again, s £ S. 

Now we construct a linear extension of P{t) in Av(123, 312). We take the set of 
values of S and T in decreasing order and place the values of T before the values 
of S. No poset constraints are violated because there can be none among the 
elements of S of the form si -< s 2 with si < s 2 for they could only arise from 
some y with siys 2 ~ 132 which would mean s\ ^ S, or among the elements of 
T of the form t\ -< t 2 with ti < t 2 since we know T has no 132-sequence, or 
across S and T of the form s -< t as proved above. 

Case 8: The basis of Av(132, 213)„4 

It is clear that every priority queue computation on a permutation which is a 
skew sum of k increasing subsequences must map it to a permutation where the 
increasing subsequences are merged together so that we have k 'bands' (sets of 
consecutive values) of increasing elements. Moreover, no elements taken from 3 
distinct bands can form a 132 pattern. Conversely, if r is a permutation of the 
latter type, it is easy to see that P(t) can have no constraints x <y where x < y 
and x and y are in different bands. For then there would be some subsequence 
xzy ~ 132; but z would lie in a higher band than y and so we would have a 132 
pattern between three elements of distinct bands. Thus Av(132, 213)^4 is exactly 
the class of permutations which can be divided into increasing bands with no 132 
pattern between three distinct bands. By inspection, none of 1432,2143,13524 
have this property. On the other hand let it e Av(1432, 2143, 13524) and con- 
sider a partition of the terms of ir into the smallest possible number of increasing 
bands. Suppose there is a subsequence xzy ~ 132 with x, y, z in distinct bands. 
Then, because of the restrictions imposed by the basis elements, it is easy to 
check that the set of elements in all the bands between (and including) those 
containing x and y form an increasing set contradicting the minimality assump- 
tion. Therefore Av(132, 213)^ = Av(1432, 2143, 13524). 

Case 9: The basis of Av(123, 132)^ 

Let r e Av(1423, 1432, 13254) be given. Let R be the set of elements that play 
the role of a '2' in a 132-subsequence of t, and let S be the set of remaining 
elements of r. Clearly t\s has no 132-subscqucnce, but also t\r avoids 132. For 
suppose that t\r contained a subsequence ftm ^132. Since t E R there is a 
subsequence axt ~ 132. Then x must precede / else fxtm ~ 1432. Also, since 
/ e R, there is a subsequence bpf ^132. Then p < t else bftm ~ 1432, and 
p > m else bpftm ~ 13254. But, if p precedes x then bpxf ~ 1432, and if p 
follows x then bxpt ~ 1423. So, we have a contradiction in any case, and thus 
t\r must avoid 132. 

For each r £ R let A r = {a ayr ~ 132 for some subsequence ayr of r}. Then 
we have 
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• A r C S, and 

• for all b if a < b < r and a E A r then b E A r . 

For the first part, suppose that xza 7 ayr ~ 132. If z < r then xzays ~ 13254, 
if r < z < y then irzas ~ 1423 and if y < z then xzyr ~ 1432 yielding a 
contradiction in each case. 

For the second part let ayr ~ 132, and a < 6 < r. If 6 follows r then ayrb ~ 1432, 
and if 6 follows y but precedes r then ayfer <~ 1423. So, 6 precedes y, hence 
byr ~ 132 and 6 G A r . 

It follows that if a G A r , and a 6 A„ then r = u (otherwise we would have 
r E A u or vice versa from the second part, contradicting the first part). 

Construct 7 G Av(123, 132) as follows: begin with the elements of S in de- 
scending order and, for each r G R place it immediately following the smallest 
element of A r . 

To complete the proof we must show that 7 is a linear extension of P{t). In 
other words we must show that for, every x < y in P(t), x precedes y in 7. 
Now x -< y arises either because xy is an inversion of r or because xzy ~ 132 
is a subsequence of r. In the latter case we have x G A y and, as y follows the 
elements of A y in 7, y follows x as required. The former case likewise holds 
easily if x and y both belong to R or both belong to S. Suppose that y G R 
and x G S. Let a be the least element of A y . Then a < y < x, so x precedes a 
and hence y in 7. Finally, suppose that y E S and x E R. Since x > y, and a; 
precedes y in t, y G" A^, and in fact y < a for all a £ 4. By construction, y 
follows all such a in 7, and hence also follows x. 

Case 10: The basis of Av(123, 213) A 

Let r G Av(1243, 2143) be given. Let A be the set of elements that play the role 
of a '1' in a 132-subsequence of r, and let B be the set of remaining elements of r. 
Clearly t\b has no 132-subsequence, and by 1243-avoidance, t\a is decreasing. 

For each a E A let B a = {b | ayb ~ 132 for some y}. Observe that 

• B a C B since t|a is decreasing, and 

• For all b' if a < b' < b and b E B a then b' E B a . To prove this choose y so 
that ay& <~ 132. We see that b' cannot precede a (or b' ayb ~ 2143), nor 
is positioned between a and y (or ab'yb ~ 1243), so 6' follows y and thus 

G B a . 

It follows that if b E B a , and b E B a > then a = a' (otherwise, from the second 
part, we would have one of a' G £? a or a G £? a ' which would contradict the first 
part). 

Construct 7 G Av(123, 213) as follows: begin with the elements of B in de- 
scending order and, for each a E A, place a immediately preceding the largest 
element of B a . 
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To complete the proof we must show that 7 is a linear extension of P(t). As 
in the previous case we must show that, for every x -< y in P(t), x precedes 
y in 7. Again x -< y arises either because xy is an inversion in r or because 
irzy ~ 132 is a subsequence of r. In the latter case y € B x and, by construction, 
:r precedes all elements of B x in 7. The former likewise holds easily if x and y 
both belong to A or both belong to B. Suppose that x £ A and y £ B. Since 
x > y, x precedes y in 7 as required. On the other hand suppose that y £ A 
and x £ B. Then, since x > y but x precedes y in t, a; ^ Bj,. Therefore x is 
greater than the largest element of B y and precedes y in 7. 

Case 11: The basis of Av(132, 231) A 

Let r g Av(1432, 2431) be given. Let T be the set of elements that play the 
role of '2' in a 132-subsequence of r and let S be the remaining elements of r. 
Then observe 

• There are no constraints t -< s with t £ T and s £ S. Such a constraint can 
arise either because i > s and i precedes s in r (and then, as t £ T, we can 
find a subsequence xyt ~ 132 in which case xyts ~ 1432 or xyis ~ 2431 
which are forbidden) or because there is a subsequence tvs ~ 132 of r 
contradicting that s ^ T. 

• There are no constraints si -< S2 with s\ < S2 between elements of S. This 
could only occur if there was a subsequence S1VS2 ~ 132 of r contradicting 
that s 2 £ T. 

• There are no constraints t\ -< ti with t\ > ti between elements of T. If 
so, t\ £ T implies that there is a subsequence aht\ ~ 132 and then the 
subsequence abtitz is either isomorphic to 1432 or 2431. 

Now define a to consist of the elements of S in decreasing order followed by the 
elements of T in increasing order. Since no constraints are violated this permu- 
tation is a linear extension of P(t) and, by construction, it lies in Av(132, 231). 

Case 12: The basis of Av(132, 312)^ 

Any permutation in Av(132) is, by Proposition ll.21 the image of some decreasing 
permutation, and decreasing permutations are members of Av(132,312). 

Case 13: The basis of Av(213, 231)^ 

Permutations of Av(2143, 2413, 2431) are easily seen to be a merge of two se- 
quences A and fi where A avoids 132, [i is increasing, and all terms of fi are 
less than all terms of A. A pre-image in Av(213, 231) is found as follows. Con- 
sider a priority queue algorithm that generates A from a decreasing sequence: 
a series of input and delete operations. We insert into this operation sequence 
insert-delete pairs that generate the interpolated elements fi as and when they 
are needed. Because fj, < A a newly inserted m £ ^ will be the minimal entry 
of the priority queue and will then be immediately deleted. 

Case 14: The basis of Av(213, 312) A 
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Permutations of Av(2143, 3142, 4132) are easily seen to have the form A/i where 
A is increasing and fi avoids 132. Hence we can find a pre-image of the form A/i' 
where y! is a decreasing pre-image of fi. 

Case 15: The basis of Av(123, 321)^ 

This is a routine check of finitely many permutations. 

For three or more basis elements we merely state the results for precisely three 
basis elements and only for the infinite classes Av(a, /3,7). The proofs are 

routine. 

Basis of C Basis of CA 



123, 


132, 


213 


1243, 1423, 1432, 


2143 


123, 


132, 


231 


1423, 1432, 2431, 


13254, 461325 


123, 


132, 


312 


132 




123, 


213, 


231 


1243, 2143, 2413, 


2431 


123, 


213, 


312 


1243, 2143, 3142, 


4132 


123, 


231, 


312 


2413, 2431, 3142, 


4132, 13254 


132, 


213, 


231 


1432, 2143, 2413, 


2431 


132, 


213, 


312 


132 




132, 


213, 


321 


321, 2143, 2413 




132, 


231, 


312 


132 




132, 


231, 


321 


231, 321, 2143 




132, 


312, 


321 


132, 312, 321 




213, 


231, 


312 


2143, 2413, 2431, 


3142, 4132 


213, 


231, 


321 


213, 231, 321 




213, 


312, 


321 


312, 321, 2143 




231, 


312, 


321 


231, 312, 321 





4 An infinitely based Ay (a) A 

This section is devoted to proving 
Theorem 3. Av(2431)„4 is not finitely based. 

We consider the infinite family 

2 to + 1 (4 1) (6 3) (8 5) (10 7) ... (m - 4 to - 7) to - 2 m to - 5 m - 1 m - 3 

for even to > 4. The parentheses simply indicate how members of this family 
are formed. A typical member of the family is 

2 13 4 1 6 3 8 5 10 12 7 11 9 

We shall prove that 

• no permutation in this family lies in Av(2431)„4, and 
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• all proper subpermutations of such permutations lie in Av(2431)A 

To see the first of these consider a typical member r of the family. We have 
to prove that every linear extension of P(r) contains 2431. For a contradiction 
suppose that A is a linear extension containing no 2431 pattern. 

In P(r) we have m < m — 1 -< m — 3 so, in A, m — 2 cannot precede m (or 
m — 2mm— 1 m — 3 would be a 2431 pattern). Therefore (as m — 2 -< m — 5 
in P(t)) A has a subsequence m m — 2 m — 5. But this means that m — 4 
cannot precede m in A (or m — 4mm — 2m — 5 would be a 2431 pattern). 
But, again, m — 4 -< m — 7 means that A has a subsequence m m — 4 m — 7 
and hence m — 6 cannot precede m in A because it would give a 2431 pattern 
m — 6mm — 4m — 7. Continuing to argue in this way we eventually conclude 
that m must precede 4. However 2 -< 4 -< 1 and 2 -< m and this implies that 
2 m 4 1 is a subsequence of A, a contradiction. 

The second thing we have to prove is that, if r' is the result of removing an 
arbitrary point of r then P(r') has a 2431-avoiding linear extension (so that 
t' e Av(2431),4). 

For illustrative purposes we take 

r = 2 13 4 1 6 3 8 5 10 12 7 11 9 
and consider the following linear extensions of P(r) 

13 2 4 1 6 3 8 5 10 12 7 11 9 

13 2 4 1 6 3 8 5 12 10 7 11 9 

13 2 4 1 6 3 12 8 5 10 7 11 9 

13 2 4 1 12 6 3 8 5 10 7 11 9 

13 2 12 4 1 6 3 8 5 10 7 11 9 

which are derived from r itself by interchanging the first two terms and by 
changing the position of 12 so that it is successively before 7, 10, 8, 6, 4. These 
linear extensions each have a unique subsequence isomorphic to 2431 (respec- 
tively 10 12 11 9, 8 12 10 7, 6 12 8 5, 4 12 6 3 and 2 12 4 1). 

In general any constraint x -< y of P(r — k) is also a constraint of P(t) and 
therefore if we remove a point k from a linear extension of P(r) we shall obtain 
a linear extension of P(r — k). For any k < 13 there is at least one of the linear 
extensions in the above list which, when k is removed, does not contain 2431 
yielding a linear extension of P(r — k) that does not contain 2431. For k = 13 
the linear extension of 12 2 4 1 6 3 8 5 10 7 11 9 does not contain 2431. 

The general case is completely similar. 
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5 Conclusions and open questions 



Most of our paper has been about CA where C is a pattern class with basis 
elements of lengths 3. It seems to be very difficult to describe CA for an arbitrary 
pattern class. However, it is possible that, at least for principal pattern classes 
C = Av(a), it might be possible to solve the finite basis question in general. We 
have run some computer experiments in the case \a\ = 4 which seem to indicate 
that most of these 24 classes are finitely based. However we are very far from 
finding any general necessary and sufficient conditions for Av(a)_4 to be finitely 
based. 

There is, of course, the dual problem: given a pattern class C determine the 
pattern class AC which is the set of permutations that a priority queue can 
transform into a permutation of C. If C contains every increasing permutation 
then AC is the set of all permutations so the problem is only interesting if 
the basis of C contains Lk = 12 ■ ■ ■ k for some k. For Av(t^) itself the class 
of permutations that can transform to it is exactly Av(tfc). This is because 
every permutation of Av(i&) can transform to itself. But a permutation not 
in Av(ife) contains an increasing subsequence of length k and this subsequence 
is transformed without change. These remarks give one hope that this dual 
problem might be tractable. 

In particular the classes _4Av(123,7r) are all easy to describe for it a non- 
monotone permutation of length 3. Specifically: 



• _4Av(123,132) = Av(123,132) 

• _4Av(123,213) = Av(123,213) 

• ,4Av(123,231) = 52413[X»,D,1,D,D] 

• _4Av(123,312) = 35241[X>, 1,X>, £>,£>] 



The argument in each case is very simple: based on the structure of the per- 
mutations, t, in Av(123,7r) given in Table [1] the linear extensions of P(t) can 
be explicitly listed which, according to Proposition 1 1.31 provide the elements of 
,4Av(123,tt). 

Finally we remark on a more general context for the results in this paper. We 
can consider down-sets of permutation pairs other than A and corresponding 
analogues of the C — > CA operator. These down-sets B arise in just the same 
way as they arise for pattern classes by forbidding one or more pairs to be 
contained in the pairs of B. However natural examples are not so readily found. 
One such is the set defined by the forbidden pair (12, 21) which defines the weak 
order and some preliminary work on this case may be found in [5] . 
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